AIbase
Home
AI Tools
AI Models
MCP
AI NEWS
EN
Model Selection
Tags
4bit Quantized Inference

# 4bit Quantized Inference

Deepseek R1 Chinese Law
Apache-2.0
Llama model trained with Unsloth and Huggingface TRL library, achieving 2x faster inference speed
Large Language Model Transformers English
D
corn6
74
2
Llama 3.2 11B Vision Invoices Mini
Apache-2.0
A multimodal large language model fine-tuned based on unsloth/llama-3.2-11b-vision-instruct-unsloth-bnb-4bit, supporting visual instruction understanding tasks, with Unsloth optimization doubling training speed.
Text-to-Image Transformers English
L
atulSethi
46
1
Awportrait FL NF4
Other
BNB-NF4 quantized version of AWPortrait-FL, a text-to-image generation model developed based on FLUX.1-dev
Image Generation English
A
skunkworx
34
1
C4ai Command R V01 4bit
This model is a 4bit quantized version converted from CohereForAI/c4ai-command-r-v01 to MLX format, supporting multilingual conversations and tool usage.
Large Language Model Transformers Supports Multiple Languages
C
mlx-community
381
23
Featured Recommended AI Models
AIbase
Empowering the Future, Your AI Solution Knowledge Base
English简体中文繁體中文にほんご
© 2025AIbase